|) National Council 
= on Teacher Quality 


STATE POLICY BRIEF — APRIL 2022 


Ensuring Students’ Equitable Access 
to Qualified and Effective Teachers 


How states have responded to a 2015 federal law that they collect and report on the 


equitable distribution of teacher talent across their schools. 


All students deserve equal access to qualified 
and effective teachers. 


When Congress reauthorized the Elementary and Secondary Schools Act in 2015, it 
intended to send a strong signal: any further encroachment of federal authority on 
the nation’s K-12 schools needed to end. Compared to its more prescriptive 
predecessor in 2000, known as No Child Left Behind, the new law, dubbed "ESSA" for 
the Every Student Succeeds Act, established a set of goals states should strive to meet, 
only one of which is the subject of this analysis: Ensuring that all students have 


equal access to qualified and effective teachers. 


Before the law's signing in 2015, there was momentum around this issue with the 


federal government requiring states to submit “equity plans” and offering significant 
guidance to states on how to do so. 


Here we examine the status of the ESSA provision six years after it was signed into 
law, analyzing how states responded to the law's requirement that they must collect 
and report the necessary data documenting the equitable distribution of their teacher 


talent among their schools. 
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It is not surprising to find an unusually large range of 
approaches taken by states. 


ESSA grants considerable leeway to states, both by design and de facto. With vague 
language in the law and the rescinding of regulations by the Trump Administration, 
their abeyance resulted in states mainly deciding what data to report and when to 
report it, and state plans being approved that did not meet the law's requirements. 
The Biden Administration has also not attempted a mid-course correction to provide 


more specific guidance. 


While it may be too soon to tell if giving states more discretion and authority to solve 
key education challenges will lead to more or less progress on solving such 
challenges, this provision serves as a good test case. Detailed in their plans, states 
arrive at their own definition of what it means to be teaching out-of-field, how 
many years of experience a teacher must have before they can be considered 
sufficiently experienced, and even if they would include any measure of a teacher's 
effectiveness. Some disadvantages of this ambiguity are that one state cannot be 
compared with another state, and that such comparisons can often inspire states to 


want to improve their standing. 


The absence of any federal timelines associated with collecting, posting, and 
refreshing the data turns up a predictable result—that some states feel a greater 
urgency than do others in addressing this well documented educational challenge. A 
void in the data leaves little room for action, the ability to identify leading states and 


districts, and most importantly the ability to gauge if progress has been made. 
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What does the research say about the distribution of teacher talent? 


Research is definitive on this finding: a high correlation exists between a teacher's effectiveness and their 
students' academic growth. | 


Further, most research exploring the question of equitable distribution of teachers finds that students with 
various measures of disadvantage (most often looking at those from low- income backgrounds, but in 
some cases also looking at students of color) tend to have less effective teachers, as measured by 
teachers' value added scores.” (One notable exception is a study of 26 districts finding no evidence that 
teachers are distributed inequitably.*) The research also finds that students from more disadvantaged 
backgrounds tend to have lower-quality teachers using other criteria such as years of experience, 
licensure test scores, competitiveness of their undergraduate institutions, and board certification.* 


A recent study from the CALDER Center, using experience as a proxy for teacher quality, found students of 
color in Washington were more likely to be assigned a novice teacher than other students. The study’s 
researchers posit that if school districts were to alter the practices that create the current inequities in how 
teachers are assigned—instead ensuring that novice teachers are no less likely to be assigned to some 
schools over others—that schools could achieve the equitable distribution of teacher talent within only five 
years. 


What the law requires: 


To comply with the 2015 reauthorization of the Elementary and Secondary Education 
Act, or “ESSA,” the U.S. Department of Education required each state to submit a 
plan to “describe how low-income and minority children’ enrolled in schools 
assisted under Title I, Part A are not served at disproportionate rates by 
ineffective, out-of-field, or inexperienced teachers, and the measures the SEA 
will use to evaluate and publicly report the progress of the SEA with respect to 


such description. ”° 


Without the regulatory guidance that the U.S. Department of Education normally 
issues to accompany a new reporting requirement, states were left with little 
guidance to create quality plans to meet the law’s requirements. Specifically, three 


problems affecting the quality of the data stand out: 
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1. The law does not define the key metrics states must use to report equitable 


distribution. The law identifies but does not define the three measures that 
indicate to varying degrees if teacher talent is equitably distributed among 
schools: 1.relative effectiveness; 2. the assignment of teachers to teach subject 
matter outside their certification area known as “out-of-field" teaching; and 3. 
teachers’ years of experience.’ In guidance issued by the U.S. Department of 
Education in June 2017, the federal government declined to impose standard 
definitions, reiterating that “in cases where the statute does not define a specific 


term, a State has significant discretion to determine how it will define that term."® 


2. The law requires states to only report state-level data. States are not required to 
report anything more than summative data, meaning they are only obligated to 
report state-level data that reports on disparities between all of the Title I schools 
in the state versus all of the non-Title I schools —revealing no disparities at the 


level of the LEA (school district) nor at the level of individual schools. 


3. The law does not impose any reporting deadlines. Since the U.S. Department of 
Education chose not to impose any reporting timelines, every state decided when 


and how often to report the data. 


How states responded to the law: 


While the U.S. Department of Education has approved every state plan, (and only 
Pennsylvania has not published any data), there are a number of states that do not 
adhere to the provision's statutory obligations, with lax federal approval processes 
partially to blame. In fact, only about a third of states have made a comprehensive 
effort to comply with all components of the law, reporting on all three required 


measures and making their data available at the school level. 
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SUMMARY OF FINDINGS 


1. Fewstates report on all three measures of teacher quality. Only 18 states publish 
data addressing all three measures of teacher quality required by the law 
(inexperienced, out-of-field, and effective teaching). However, two states, 


Arkansas and Colorado, stand out as national models worthy of emulation.° 


2. There are no consistent definitions for any of the metrics. Lacking federal 
definitions, states came up with their own. For example, across all states, there 


are five different definitions for what defines a sufficiently experienced teacher." 


3. Many states do not share sufficiently disaggregated data. While states had to 
have collected data from their school districts and most likely schools, many 
states don’t make this data public, choosing instead to only report summative 
data for the whole state: 17 states (including Pennsylvania, which did not report 
any data at all) did not publish any disaggregated data. Only 34 states report 
school-, district-, and state-level data. Even more states (37) fail to disaggregate 
their data to show the distribution of teachers in schools serving large proportions 
of students of color, despite the clear reference to students of color in the ESSA 


provision. 


4. Shared data lacks context for meaningful comparisons. Comparisons within 
states are difficult to make as many states fail to provide context, such as the 
relative distribution of a LEA's or school's teachers compared to the state average. 
Limited years of data also restricts the ability to understand trends in progress or 


regression towards the overarching goal of eliminating equitable access gaps. 
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FINDING 1 


Few states report on all three measures of 
teacher quality. 


Most states have “cherry picked” which provisions they are willing to report. To be 
clear states were given the authority to do so and are therefore not out of compliance. 
Still, what measures do states use to decide if the distribution of teacher talent is 


inequitable? 


Of the 50 ESSA plans that have been approved by the U.S. Department of Education, 
only 18 states report data on all three measures named in the law to indicate that a 
teacher is both qualified and effective (experience, out-of-field, effectiveness). The 
remaining 33 states elected to report on fewer than three measures: one reported 


none, six reported one and 26 reported two. 


Which measures do states use to report on teacher quality? 


Summary of key Ineffective teachers Teachers teaching out Inexperienced teachers 
measures reported of field 


State reports only on out-of-field. 

i State reports only on inexperienced. 

Mj State reports only on ineffective. 

Wi State reports on out-of-field and inexperienced. 

Mi State reports on ineffective and inexperienced. 

Mi State reports on all three key measures. 

Hi State does not report on any of the three key measures. 


View this map on the NCTQ website for interactive features. 
Visit www.nctq.org/publications/Ensuring-Students-Equitable-Access-to-Qualified-and-Effective-Teachers. 
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Most states show a clear preference for reporting on 
some measures, steering clear of any measure of 
teacher effectiveness. 


e 45 states report some kind of data on teachers who are assigned to teach subjects 
outside their certification area, with only six not addressing the area of out-of- 
field teaching (Illinois, Indiana, North Carolina, Oregon, Pennsylvania, and 


West Virginia). 


e 47states report some kind of data on the experience level of their teachers with 


only four that do not (Illinois, Oklahoma, Pennsylvania, and Vermont). 


e Many fewer states—only 20—report on the distribution of effective teachers 
among their schools, a surprisingly low number given that a number of states had 
effectiveness data, but decided not to use it for these purposes (see below). 
Furthermore, some applied proxies for effectiveness that related more to 
teachers’ certification status or teaching assignment, rather than their ability to 


improve student outcomes. 


A missed opportunity 


Quite a few states (19)! have access to teacher performance data, but elected not to use it here to track 
the distribution of effective teachers among their schools. 


Objective measures of student growth such as value-added models are an important tool for measuring 
student learning. These models have the ability to measure individual students’ learning gains, controlling 
for students’ previous knowledge and background characteristics. 


Given the wide scale problems over adopting more meaningful teacher evaluations, defining effectiveness 
remains a challenge for states. However, regarding those states that already collect teacher performance 
date, publicly reporting this measure could have provided a critical metric to assess the strength and 
distribution of the teacher workforce. 


'The 19 states are: Alabama, Arizona, Connecticut, Delaware, Georgia, Hawaii, Idaho, Minnesota, Mississippi, New Jersey, New York, 
North Dakota, Oregon, Rhode Island, South Carolina, Tennessee, Utah, Washington, and West Virginia. 


National Council on Teacher Quality 7 


Many states elected to add additional measures not 
named in the law. 


A number of states inserted additional teacher attributes or measures into their 
reporting—even while also choosing not to report on the three measures stated in the 
ESSA provision. These indicators vary in the degree to which they provide 


meaningful insight into the equitable distribution of the teaching corps. 


e 15states" examine rates of retention," a useful addition given that high needs 
schools are more likely to report high attrition. While some attrition is generally 
advisable, constant and substantial teacher churn undermines student 


achievement gains.” 


e 6states chose to report on teacher attendance. Connecticut, Illinois, Louisiana, 
Nevada, New Mexico, and Ohio chose to report on variations in teacher 
attendance between their Title I and non-Title I schools. While the research is 
quite mixed on whether teachers working in Title I schools are more likely to be 
absent, attendance could be a useful measure in that frequent teacher absences of 
ten days or more have been shown to have a significant negative impact on 


student performance.” 


e 16states" chose to report on the distribution of their teachers who hold an 
advanced degree, though there is definitive consensus in the research that 
teachers holding an advanced degree are no more effective than teachers not 


holding such a degree." 


"The 15 states are: Arkansas, Delaware, Idaho, Illinois, lowa, Kentucky, Louisiana, Massachusetts, Michigan, Missouri, New Jersey, 
South Carolina, Tennessee, Utah, and Vermont. 

" The 16 states are: Alabama, Alaska, Arkansas, California, Illinois, Kentucky, Maine, Michigan, Minnesota, Nebraska, New Jersey, Ohio, 
South Carolina, South Dakota, Virginia, and Washington. 
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Additional measures reported by states 


Attendance and Educational attainment 
Retention 


Wi Attendance and retention L_] Attendance 

Mi Retention 8 Neither attendance nor retention 
Attendance and Educational attainment 
Retention 


yes Wi No 


View these maps on the NCTQ website for interactive features. 
Visit www.nctq.org/publications/Ensuring-Students-Equitable-Access-to-Qualified-and-Effective-Teachers. 


National Council on Teacher Quality 


FINDING 2 


There are no consistent definitions for any of 
the metrics. 


As neither the law nor the U.S. Department of Education has imposed standard 
definitions for the measures states are to use, states were left to define their own 
measures. States tended to provide different answers to such questions as "How 
much experience should a teacher have in order to deem the teacher fully qualified?" 
or "On what basis is a teacher classified as “out-of-field?” Accordingly, that makes it 


impractical to compare the distribution of qualified, effective teachers among states. 


States use no fewer than five definitions of teacher 
inexperience.'° 


Unfortunately, states have arrived at definitions that are not well grounded in what 
research findings, a particular problem when it comes to how states have defined 


what it means for a teacher to be “inexperienced”. 


e For example, six states (Connecticut, Delaware, Florida, Georgia, Mississippi, 
and Washington) set quite a high threshold for defining a teacher with sufficient 
experience, choosing four or five years of experience as the threshold a teacher 
must meet. However, the research definitively shows that teachers on average are 
only far less effective in their first and second year of teaching, and only 
somewhat less effective in the third year than in future years.'® Attaching a label 
of “inexperience” to a teacher in her 4" or 5" year is not meaningful in terms of 


questions of student access. 


e At the other end of the spectrum are nine states (Alaska, the District of 
Columbia, Hawaii, Idaho, Louisiana, Missouri, Montana, Vermont, and 
Virginia) that consider a teacher to be “inexperienced” only in the first year, 
ignoring the fact that second-year teachers too are on average significantly less 


effective than other teachers. 
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After how many years of teaching do states consider a 
teacher to be "experienced"? 


26 


25 


20 


# of states 
un 


10 


0 


6 
end 
1 year 2 years 3 years 4 years 5 years 


In this chart, years are defined as complete years of experience. For example, a state 
in the 3 Years category captures a state that defines an inexperienced teacher as a 
teacher that has been in the classroom for less than three full years. At the conclusion 
of their third year of teaching, the teacher would then be considered experienced. 


State definitions for "out-of-field" teaching, don't just 
vary but spill over into unrelated metrics. 


Out-of-field teaching is traditionally interpreted as the practice of assigning a 
teacher to teach a course for which he or she lacks certification. Yet in reporting out- 
of-field teachers, 8 states also define teachers who are classified as “probationary” — 
meaning they are still new to the profession or have not met full licensure 


requirements—as teaching out-of-field. In some cases, probationary teachers may 


well be fully certified to teach a particular subject.” 


While most states report out-of-field teaching as the percentage of their teachers 
who are assigned to teach one or more classes outside their area of certification, four 
states (California, Florida, New Hampshire, and Minnesota) define out-of-field- 


teaching in terms of the percentage of classes taught by a teacher who is out-of-field. 


The effect of this decision is to bring down the number of out-of-field teaching quite 
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substantially compared to states employing the more traditional definition. As a 
unique twist, another two states, Kentucky and Louisiana, report out-of-field 
teaching as the percentage of students who are assigned to a class that is taught by a 


teacher who is out-of-field in that subject. 


FINDING 3 


Many states do not report sufficiently 
disaggregated data. 


First and foremost, a number of states (13) do not report school-level data, which 
is where most of the variation will take place. A recent brief by The Education Trust 
finds that among half of states, disparities in student access to experienced teachers 


exist mainly between districts, while in the remaining half, the variations exist 


primarily within districts, based on 2017-2018 OCR data.'® 


For example, in Kentucky's 4th largest district (Warren County), 5.2% of students in 
its Title I schools are taught by teachers classified by the state as “ineffective, " 
compared to only 0.3% for other Title I schools elsewhere in the state. This disparity 
effectively means that a student going to a Title Ischool in Warren County is 17 times 
more likely to be taught by an ineffective teacher than in other Title 1 schools in the 


state. State-level data alone would not be able to identify this gap. 


Third, few states disaggregate data in order to permit comparisons between 
students of color and White students. Though the provision explicitly calls out the 
need to compare the distribution of teachers based on student race and ethnicity, 


only 12 states elected to do so. 


States likely found this provision in the law to be too heavy a lift, perhaps an 
unfunded mandate, given that it would have required them to capture data that most 


currently may not collect, including teacher assignment and student enrollment data 
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at the individual course level. States could have provided some insight into this issue 
by reporting on those schools educating high percentages of students of color which 


were not also Title I schools, but none choose to do so. 


Recent work by The Education Trust underscores the need for states to undertake 
this comparison, finding that Black students are both more likely to attend schools 
that have higher percentages of novice teachers, and are more likely to be assigned to 
a new teacher. Similarly, a companion report found in 37 states that the percentage of 


novice teachers in schools serving the most Latino students was higher than those 


schools serving the fewest Latino students.” 


State Spotlights: Why school-level data makes a difference 


By adopting school level disaggregation, Florida was able to learn that Miami-Dade's Title | schools were 
no more likely to have out-of-field teachers as more affluent schools in the district. Further, the proportion 
of classes taught by out-of- field teachers in these Title | schools was roughly half the state average, a 
reason to celebrate. 


Rhode Island reports that 14% of the teachers in its largest school district, Providence, meet its definition 
of "inexperienced" (0-3 Years), but it is how the state breaks that data down that allows state and district 
leaders to push for changes. Because the state made it possible to distinguish between secondary and 
elementary schools—something few other states did—it learned that most of these inexperienced 
teachers were landing in high poverty secondary schools (21.5%) as opposed to its high poverty 
elementary schools (12.7%). 


Achieving more equitable distribution is not an easy task, but one local leaders 
cannot achieve without the data. The answer isn't necessarily to involuntarily move 
teachers, but even more intentional assignments within a school can achieve greater 
parity of student experiences. As part of this early equity gap work, Massachusetts 
embarked on a project to understand from the student experience their interaction 
with out-of-field, inexperienced, or ineffective teachers. This report examined 
patterns of assignment at the student level (e.g., How many times did Student A have 
an experience with an ineffective teacher?). This type of system is a role states can 


and should play in providing useful, actionable data for district and school leaders. 
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FINDING 4 


Shared data lacks context for meaningful 
comparisons. 


The quality of a state's reporting is not only informed by what they report, but also 
how well they present it and how often they report it. While 33 states outlined in 
their initial plans that they intended to publish the data annually, few states have met 
these self-imposed deadlines. The remaining 18 do not specify in their state ESSA 
plans when they would make the data public nor how often they plan to refresh the 
data. Providing context and trends over time allows leaders to learn from others who 


are making progress. 


Four factors relate to how data can be best displayed: 


1. Key terms are defined and easily accessible to be able to interpret what the 
measure represents. By way of example, Virginia and Washington state both 
display the distribution of their inexperienced teachers, with Washington 
reporting what appears to be a nearly 20-percentage-point higher share of 
inexperienced teachers than Virginia. However, the difference is misleading, in 
that Washington sets a five-year threshold for experience—a definition that it 
clearly displays—compared to Virginia, which sets a threshold of only one year of 


teaching—a definition that Virginia does not display. 
2. The data is accompanied by detailed charts, graphs or other data visualizations. 
3. Key trends and insights are accessible. 


4. The state makes it possible to download raw data. The ability to download or 
export the full data set unlocks it for further analysis, so that researchers and 
policymakers are able to manipulate the raw data in a .csv format, leading to 


further investigation and insight. 


National Council on Teacher Quality 


14 


Washington state's display of its data illustrates how each of these four factors 


improve the user experience: 


Teacher Qualification 


Course ContentArea GradeLevel Trend Quartile Quartile Trend 


What were the qualifications of classroom teachers? 


Seattle School District No. 1 
2020-21 


Ve) eae) o)at-1¢-B-ter-|ilale melt) diac mere) (0) a 


Clear data labels 


inexperienced status 


29.0% 


Summary statements 


Talccigela-idlalemele-lela) 


Limited Certificated status 


During the 2020-21 school year, 219 of the total 3,700 classroom teachers in Seattle School District No. 1 were Out-of- 
Field status. That is 5.9% of the classroom teachers in Seattie School District No. 1 


T 
a 


Out-of-Field status 


This graph shows the percent of teachers by qualification. Inexperienced status means that a teacher had fewer than or equal to five (5.0) years 
of teaching experience. Out-of-field status means that a teacher taught one or more courses outside of their endorsement area. Limited 
certificate status means that a teacher taught under a limited certificate. A high percentage in one of these qualifications may mean there is a 
need for more teacher support, mentoring, retention, induction, professional learning, or recruitment. 


Ability to download full data in .csv format 


terms directly 
lol=} (eh me t-1e- Melly e)t-hy 
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CONCLUSION AND RECOMMENDATIONS 


It’s not too late to fix this problem. 


Absent federal requirements that would require states to disaggregate their 

distribution data at a school-level or adhere to a set of common definitions defined at 
the federal level, it is not surprising that states have taken many different approaches 
and manifested a range of commitment to measuring the distribution of their teacher 


workforce. 


However, this level of variability is not unique to this provision. When it comes to 
federal education policy, it is not a given that more prescriptive approaches lead to 
greater or more genuine commitment on the part of states. For example, there is little 
evidence that the far more prescriptive "highly qualified teacher" requirement found 
in the 2000 No Child Left Behind Act was a successful effort to improve teacher 
quality. On the other hand, the lack of impact from that failed provision may be 


attributable to a poorly conceived and executed solution, not its prescriptive nature. 


This newer provision under ESSA advanced a much less ambitious design, with no 
hint of a federal hammer. As documented here, many states will not achieve its most 
basic aim, failing to quantify the extent to which low-income students and students 
of color have less access to qualified and effective teachers than other students in 
order for states and their LEAs to ameliorate any gaps. The provision did not seek to 
penalize states, districts, or teachers for what was learned, only to ensure that this 
long-standing educational challenge would be better understood, a modest goal 


falling well short of federal overreach. 


Still, while tempting, it is too soon to write off the broader positive contribution this 
provision may have in a number of states. Given the federal government's weak 
authority in education, it may be expecting too much—no matter how stringent a 
federal law—that all 50 states and the District of Columbia would equally share 
enthusiasm or urgency for any issue, no matter how compelling the evidence or 


need. Further, it could be the case that the provision's flexible nature has led more 
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states out of a compliance mindset, taking more ownership for genuinely addressing 


this problem. 


To date, the Biden Administration has not chosen to weigh in on this provision for the 
purpose of providing greater clarity than the limited guidance provided by the Trump 
Administration. While in certain respects the horse has already left the barn, there 
are still opportunities to encourage states to consider adopting common, research- 


based definitions and to publish data that is disaggregated down to the school level. 


We offer four recommendations for states to consider: 


1. Improve how data is reported so it is clearer how schools and districts fare in 
relation to the state average or other obvious points of comparison (such as 
schools and districts with comparable populations). Currently, less than half of 
states compare each LEA's distribution data to the state average. Florida and New, 


Mexico stand out as state exemplars. 


2. Add asummary calculation capturing all of the measures used to define an 
effective, qualified teacher. While it is valuable for states to report the 
distribution of teachers under each measure, it is equally valuable to produce a 
summative score, as Arkansas and Colorado have done. Colorado does this by 
publishing gap size categories; Arkansas calculates a Workforce Stability Index. 


These summary calculations convincingly show where equity gaps compound. 


3. Incorporate the best available teacher effectiveness data. Currently 31 states do 
not attempt to capture any measure of teacher effectiveness, even though 19 are 
already collecting effectiveness data for other purposes. Using available objective 
measures of effectiveness would instill greater confidence in this measure, yet 
many states choose not to include this data even though the state has it available. 
Indiana stands out as an exemplar, both for including this effectiveness data on 
the same webpage as the state's other teacher quality indicators, and for using 
measures of student growth in their teacher evaluation system. Their reporting 


could be made stronger by reporting on out-of-field teaching. 
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4. Commit to refreshing data at least every other year. States should focus on 
producing a strong trend line by which to measure progress, requiring regular 
updating of data. The only way to ensure we are addressing equitable access is 


with data. 


We offer two recommendations for the federal 
government to consider: 


1. Establish regulations to provide clear guidance to states including definitions 
and timelines for reporting. With the recovery of the pandemic front and center, 
how teacher talent is distributed is as important to understand now as ever 
before, particularly as we know students from low- income families and students 
of color suffered the most in terms of learning loss.*° Regulations provide an 
opportunity to tighten up the holes left in states’ plans by inadequate approval 


processes at the time. 


2. Invest in teacher data systems. Understandably, the pandemic and getting 
students back to in-person learning was a priority for the current administration. 
As these efforts seem to be paying dividends and most students are now back at 
in-person learning, understanding the distribution of talent must be front and 
center. Providing a significant funding opportunity for states to invest in their 
teacher data systems, would not only help states report better information on 
equity gaps for the most disadvantaged students, but could also shed more light 
on teacher supply and demand. This Administration has the opportunity to bring 


equitable access back to the forefront. 
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APPENDIX A 


Individual State Results 


Based on the data collected, NCTQ identified nine fundamental criteria to evaluate the extent to 


which states were reporting teacher distribution data and making it accessible to the public. 


View this table on the NCTQ website for interactive features, including tooltip details. 
Visit www.nctg.org/publications/Ensuring-Students-Equitable-Access-to-Qualified-and-Effective- Teachers. 
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Continued from previous page: 


State 


Does the state 
report on the 
proportion of 
inexperienced 
teachers in a way 
that is 


Does the state 
report on the 
proportion of out of 
field teachers in a 
way that is 


es approximatel 
aligned to research PP y 

aligned to researc 
consensus? 


consensus? 


Does the state 
choose to report on 
teacher 
effectiveness using published data 
definitions/ 
methodology 
h grounded in 
research? 


Does the 
— Does the state Doesthestate Doesthestate Doesthestate reporting 
publish this data disaggregate report how follow best include the 


their reporting _— individual LEA's __ practices for ability to 

by Title | and compare tothe  accessibilityin download or 

race/ethnicity? state average?  datareporting? export the full 
data set? 


at the state, 
district, and 
school level? 


at least once in 
the last 2 years? 


-_ 
o 
r 
o 
= 
° 
| 


Nebraska 
Nevada 

New Hampshire 
New Jersey 
New Mexico 
New York 
North Carolina 
North Dakota 
Ohio 
Oklahoma 
Oregon 
Pennsylvania 
Rhode Island 
South Carolina 
South Dakota 
Tennessee 
Texas 

Utah 

Vermont 
Virginia 
Washington 
West Virginia 
Wisconsin 


Wyoming 


Partially 


| 
o 
= 
° 


Partially No 


° 
r , _ _ 
o °o o o 


Partially No No 
No No No 


o o Qo | & 
a 
°o 
b 
°o 


No No 


Partially 


Partially 


= 
° 
= 
°o 


No 


Partially 


Partially N 


Partially No 


= 
°o 


Partially Partially 


= 
°o 


Partially 


Yes Yes Partially No Partially No 
Yes Partially Yess No Partially No 

Partially Partially No No Yes 
No No No No No No 
Yes Partially No No No No 
No No No No No No 


Ys Partially No 

Yess No No No 

Yes Partially No No Partially No 
Yes Yes No No Partially No 


= 
oO 
= 
o 


Partially Partially No Partially No 


Partially No No 


Partially No Partially No 


| 
i=) 


View this table on the NCTQ website for interactive features, including tooltip details. 


Visit www.ncta.org/publications/Ensurin 


-Students-Equitable-Access-to-Qualified-and-Effective-Teachers. 


National Council on Teacher Quality 


20 


APPENDIX B 


Methodology 


To determine the quality of a state's reporting, NCTQ collected and analyzed state- 
by-state reports and representative report card profiles in the winter of 2020-2021. 


The process with which to collect and verify this data is detailed below. 


Reports and representative profiles. Analysis began on a state's Department of 
Education website. The website was examined by following website paths that 


mentioned any of the following: 


e Report card 

e Data center 

e ESSA reporting 

e Educators 

e Equitable Distribution of Teachers 


e Access to equitable teachers 
When prompted for a district or school input within a report card or data reporting 
portal, the school district associated with the state's capital was queried as a 


representative profile. 


Verification. In March 2021, NCTQ contacted all 50 states and D.C. to verify the 


accuracy of the data collection. Feedback was incorporated when relevant. 
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